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(54) Digital photof Inishing system including digital image processing of alternative capture color 
photographic media 

(57) A method of digital photofinishing comprising ^ 

the steps of: producing a digital color image in printing 
densities of a color image captured on alternative cap- 
ture photographic media; first mapping the printing den- 
sities of the alternative capture photographic media to 
the printing densities that would have been obtained for 
reference color photographic media; processing the 
mapped digital color image with a scene balance algo- 
rithm to produce a processed digital color image; sec- 
ond mapping the processed digital color image through 
a hard copy media characteristic curve to produce a 
mapped digital color image mapped to print densities of 
the hard copy media; sharpening the mapped digital 
color image with a sharpening algorithm optimized to 
avoid unacceptable artifacts; and digitally printing the 
sharpened digital color image onto hard copy media. 
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Description 

FIELD OF THE INVENTION 

[0001] This invention relates in general to digital photofinishing systems and ^^^^^S^a 
ing system selectively including film under exposure gamma, scene balance, contrast normahzafon. and sharpen.ng 
digital image processing for alternative capture color photographic media. 

BACKGROUND OF THE INVENTION 

[00021 Several problem areas need to be addressed when making color negative paper printslrom color negativefSm 
°™JL Thedbiectof the process is to make a pleasing prim from the film image. The first problem is to find the level 
rex^e n^ryta^o; printer system to piduce that pleasing print In the ^^^""1° 
SI3?». coJ negate film image onto a photosensitive paper ^V^^^SS^M 
KS. repeats the process until a pleasing print has been obtained. In automated f^^^^J^ 
scanner reads densities from the negative and passes the information to a computer 
Striate exposure values so that a pleasing print can be obtained. At this port, the 

^orocess ends That is if there are any remaining problems In a photographic .mage, no other simple processes are 
*2S£Z ZSoXZ Verity of the p^em. Problems such as film under-axposure or 

gammafor a particular scene, poor quality camera or printer lenses, low or high activity off.lm orpaper processes, poor 
SeTbaTancVand poor sharpness in the final image remain that we would like to correct or modrfy. 
5£ ^SStSSwSm have been described for more than 10 years that are devoted to prolong p^ona 
Smagi on varioS mediaand devices from scenes captured on photographic film, vm scanning to produce a dtgrtal 
image, image processing, and output rendering. Examples include the foUowing. 

. Journal of Imaging Technology. V* 14. Number 3. June 1988. Frtth et al.descrtoe systems ^capture scenes 
onV scan fifm to produce a digrtal image, digitally process the image. ^^^^^ fjIm 
. U.S. Patent 4.500.919. Schreiber discloses an image reproduction system that ~ ™ ' °" f " m - 

displays the Image on a video monitor, enables image processing, and finally output » an .n^hartcopy 
. ST Patent 4.979.032 (Dec. 18. 1990. filing date: Dec. 27. 1988). Alessi et al describe an .^^^f'"^ 
film scanner, a video monitor, image processing, and output to produce various output visually matched to the 

. ul 9 pJSfS^oS ES r November 30. 1993. inventors Gtorgianni et. al. describe method arxlrneansto 
^n^mTrr^fi ca^ S onfilm. via digitization on a film scanner, to a color metric or other space, wrth output 

^iS^mSS Pleasing modifications to the tone and color reproduction as well as^arpw 
. SI latent 1.300.381 . issued April 5. 1994. inventors Buhr et. al. describe a pictona. '^9-^ s^ tt^co^sts 
of capture on photographic film, film scanning to produce a digital image. M V™***™* ^2 n^tem 
. uTWent 5 ST^sZissued November 26. 1996. inventor Takahash. d^an«M '^SSSS- 
devoted to storing or producing images that have "substantially the same color or additional ^^^cctooor 
f^versSmlonginal scene, based on a variety of image processing transformations of ^toed.maga 

• ul!TatemtL8.542 issued March 4. 1997. inventors Krahe et al. describe a system that produces index prints 
based on scanning a film frame, image processing, and rendenng. . ta . 

. US Patent4945 406 issued July 31. 1990. inventor Cok. describes a system for achieving automate color teN 
aSrS 5 b^tiansfeLg cotor pixel values from log exposure RGB color values ^Pnntingdensrty 

vS anTgenerating color correction offset values utilizing a printing density based color conecbon method. 

miniature images including: 

• digital image in film RGB printing density 

ss • aoDlvinQ a scene balance algorithm to balance the digital film printing density image 

. r^rS^or^egative digital image onto a odor paper (EDGE-type) characters curve 

digital sharpening 
. rendering using a CRT printer onto photographic paper 
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[0005] In the Index Printer, the above image processing: (1 ) is not applied to full frame images in a digital color printer; 
and (2) is not applied to high resolution images in a digital color printer, only low resolution images. 
[0006] U S Patent 5.134,573, issued July 28. 1992, inventor Goodwin, discloses a method for increasing the range 
of values representing a color image which exhibit a linear response. The toe and/or shoulder regions of the film's three 
density vs. log exposure tables are straightened using look up tables. 

[0007] U.S. Patent 5.012.333, issued April 30. 1991. inventors Lee et al., discloses a dynamic range adjustment sys- 
tem for printing digital images based on visual photoreceptor adaption and human visual contrast sensitivity. The sys- 
tem adjusts the contrast of the low frequency component only of the image, preserving the high frequency component 

in its contrast. , , . . t . . 

[0008] All of these articles or patents describe, in one form or another, processes for obtaining more pleasing prints 
from a film image capture than the conventional optical process. TTiere is thus a need for a solution to these problems, 
which can be incorporated into a digital photofinishing system. _ 
[0009] While it is straight-forward to produce high-quality images from high<juality media capture through standard 
optical-printing photo-finishing on high-quality color photographic paper using high-quality chemical processing and 
printing equipment that is properly run. it would be beneficial to produce high-quality images from capture media that 
would not produce such results using the same optical printing photo-finishing path. Such light-sensitive media might 
be lower in cost or unsuitable for optical printing, and use conventional chemical processing, alternate chemical 
processing, or other norHraditional image development processing, such as that used in instanlphotography or applied 
heat without liquids. 

SUMMARY OF THE INVENTION 

[001 0] According to the present invention, there is provided a solution to the problems of the prior art 
[001 1 ] According to a feature of the present invention, there is provided a method of digital photofinishing comprising 
25 the steps of: producing a digital color image in printing or other densities of a color image captured on arternatrve cap- 
ture photographic media; first mapping the printing or other densities of the alternative capture photographic mecSato 
the printing densities that would have been obtained for reference color photographic media; processing the mapped 
digital color image with a scene balance algorithm to produce a processed digital color image; second mapping the 
processed digital color Image through a hard copy media characteristic curve to produce a mapped digital color image 
mapped to print densities of the hard copy media; sharpening the mapped digital color image with a sharpening algo- 
rithm optimized to avoid unacceptable artifacts; and digitally printing the sharpened digital color image onto hard copy 

ESofS According to another fe^ 

prising the steps of: producing a digital color negative image in optical or other printing densities of a color image cap- 
tured on a color negative photographic element which is optimized for producing a color image suited for aversion to 
an electronic form and subsequent reconversion into a viewable form; mapping the printing densities of the digital color 
negative image to the printing densities that would have been obtained for the reference color negative photographic 
element; processing the mapped digital color negative image with an underexposure scene balance algorithm; map- 
ping the processed digital color negative image through a hard copy media characteristic curve to produce a digital 
color positive image; sharpening the mapped digital color positive image with a sharpening algorithm optimized to avoid 
unacceptable artifacts; and digitally printing the sharpened digital color image onto hard copy media. 

ADVANTAGEOUS EFFECT OF THE INVENTION 

45 [0013] The invention has the following advantages. 

1 A digital photofinishing system is provided that produces high quality digital photographic reflection prints from 
alternative color negative film images that match those that would have been obtained from a reference film at high 

so ^Sh?njess that is difficult to correct in conventional optical photofinishing systems is corrected by digital image 
processing in a digital photofinisher. . 

3. Prints produced by the digital photofinishing system of the invention were preferred over prints produced by opti- 
cal photofinishing systems. 

4. Prints produced by the digital photofinishing system that have improved overall print contrast from color film neg- 
55 atives that are under-exposed. ... . t _ a 

5. Prints produced by the digital photofinishing system that have a preferred image contrast position relative to a 

traditional optical print 

6. The contrast normalization algorithm improves quality of low contrast scenes by increasing image contrast and 
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8. Improves quality of prints producea tto 
; print contrast 

BRIEF DESCRIPTION OF WE 

1S DEFINITION OF TERMS _ arTtima l color negative film developed 

* SKS ^Tterm "alternative capture color photograp . ranB suned ic< conversion to an elec- 

pier chosen to produce image uy substantially free of colored TO *™' y • r 2 J )og E ^ere t is 

. OEIAlLEODESCBlPnOHOFTMEIKVENTOM ..„.„«-«, 10 l*»cp«W«> «» 

■"^^^iTjSiS* , . oeftom scannerl2.IDMl8ispre1era b .yadi^ 
12 and printer 20 are 'XTp^ocesses the digital color '"^oms^ 26 . Computer readable 

[0018] »™9edatan^ger(IWj^^ 

computer having user input 24 £«^^^agnUc storage media, such as amag^ ™ dectronic storage 
SoSge media may comprise , *^TdSc^S3 tape or machine readable bar J*^ dwice or medium 
Seal storage media. ^ ch ri ^ 1 ^S' 0 ?random access memory C^^SJ Ibelow can be stored on 
Sees, such as ^"^^^ digrtal image process;ng ^^S^ into programmable gate 

arrays or other hard electronic devices. 
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resolution scans. 

[0020] H is preferable that the scanner deliver the digitized data to the image processing algorithm as "printing den- 
sity." A scanner that measures printing density has red, green, and blue effective spectral response that matches that 
of photographic paper in an optical printer. Photographic films intended for optical printing are designed based on the 
expectation that the captured information in the film will be read by this type of red, green and blue spectral response 
characteristic. 

[0021] Even though the scanner is not considered part of the digital image processing path, some manipulations of 
the data may be required to deliver "printing density" to the processing algorithm. Two key steps are converting scanner 
densities to calibrated scanner densities, and converting the calibrated scanner densities to printing densities. Matrix 
operations may be required to perform these conversions. 

[0022] The first step in the process is to convert the raw scanner numbers to calibrated scanner densities. If a matrix 
operation is used, an appropriate matrix correction model is shown below. 
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W w is raw scanner number and is corrected scanner density. 

[0023] The next process in the scanner converts calibrated scanner densities to calibrated printing densities. The 
process is implemented again with a matrix model that in this case can be up to a 3 x 10 matrix multiplication. An exam- 
ple is shown below. 
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The output of the matrix multiplication is calibrated printing density. 75^ is calibrated scanner density, and is cali- 
brated printing density. Either or both of these steps can be implemented with a 3D look-up-table. 
[0024] If the scanner does not measure "printing densities" directly for the alternate capture media, the "scanner den- 
sities" produced by the scanner can be transformed to reference printing densities for the alternate capture film as the 
first step in the image processing. Alternatively, the scanner densities for the alternate capture media may be passed 
to the Image Data Manager if the image processing parameters can accommodate this input type. These pathways per- 
mits using specially designed alternate capture media and scanners that result in identical images to those that would 
be obtained with the reference media and "printing density" scanners. 

[0025] Fig. 2 is a flow diagram of a general image processing system for digital photofinishing incorporating the 
method of the invention. The diagram is divided into several sections: digital image acquisition (box 30), the analytical 
section (box 40) performs analytical evaluations to prepare shift values for color and density balance, and tone look up 
table preparation for control of final print contrast. This information is then passed into the processor section (box 50) 
of the model to prepare the digitized f ilm image for printing section (box 60). 

[0026] In the image acquisition section, an image on photographic media (negative film) (box 32) is scanned (by scan- 
ner 12) to produce a full resolution digital image (box 34). 
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expcsurevaluesbej^ 

"^measured in SSes for the reference media ^ 

alternate capture preferred method of ^^t^TS attemate capture 

[00291 ^P'«t!SSS For convenience, it may be P 80 "^^^* tab.es may also 
capture media to a specrfic reference mea« approximate conversion matnces and aoww ^up 
, media densities to one reference med£ ^^T ure me dia to reference ^ re "^^J^^erials. 
be used to effect the density ™X similar alternate capture £ j 'J^S^ESE' 



realization algorithm. This '^^^^ocessed by an equivalent process. 

5.134.573. issued July 28. 1992. imenwwuu ^ algorithm 

digital color image (box46) . . ^ ^ osing contrast "or^'^ j£,£duces final print 

10035] ^^SSm^epri the metric 

so Droduces a look-up table that is useo'" > » does the slope correction in rrtatiQn t0 t-space" 
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based on the DX code on the media. 

[0038] The look-up table that is applied to correct the gamma of the capture media in the under-exposure region may 
be obtained from a number of different sources. The look-up table may be encoded optically or magnetically on the cap- 
ture media. The look-up table may be calculated by the software from reference exposure patches on the capture 

5 media Media reference exposure patches are described in U.S. Patent 5.649,260. The look-up table or look-up table 
precursor data may be encoded on optical, magnetic, or other media that accompany the capture media. The look-up 
table may be selected or supplied, directly or indirectly, by the customer or processing lab. The look-up table may be 
accessed from a software embodiment database, based on the media type, lab preference, or customer preference. 
The look-up table may also be accessed via the intranet from an available repository, based on the media type, lab pref- 

10 erence, or customer preference. 

[0039] U.S. Patent 5,1 34.573 teaches the calculation of correction look-up table with a limiting gamma enhancement 
value to avoid unwanted noise introduction. We have found that it is preferable in some cases to calculate the correction 
look-up table as a fraction, such as 0.5. of the gamma adjustment factor that is required to fully correct the media toe 
gamma to match that of the media in a normally exposed region. 

is [0040] In the absence of an exposure-density sensttometry present on the specific media providing the image that 
are being processed, the look-up table may be derived from different media response approximates, such as media aim 
sensitometry. In general, in the absence of customer preference, media-type specific look-up tables provide higher 
quality images, and the most preferred are the media-type population averages for the processing lab. 

20 Scene Balance Mapping 

[0041 ] The process of operating a two stage film/media printing system has as its most imposing task that of finding 
a density value on the fflm exposure and mapping the densities on that negative to the media so that the best overall 
density and color balance are obtained, The process is best illustrated by tying together a series of reference points 

25 showing the connections from a scene object to the photographic reproduction of the object 

[0042] Fig. 3, below, illustrates the concept of density tie points in our analysis of printing process. This process ties 
an initial target usually a uniform gray card, to the photographic reproduction of that target Test points are established 
for the initial exposure of the target object as an expected reference fflm density from a film reference exposure for the 
test object The quadrant labeled "Printer merely reflects the film reference density to the log exposure axis of the 

so media The test target will be assigned a density to be achieved for the reproduction of that object or a density at the 
paper balance point This point is characterized as the media reference exposure value and a media reference density 
value. 

[0043] The objective of the scene balance process is to first determine the film density value for the film reference 
exposure and to determine the difference between this film density value and the media reference exposure value. The 
ss difference, or A, is added to the film reference density. This process assures that the quadrant labeled "Print Through" 
will yield the appropriate print density in the final reproduction of the scene. 

[0044] Real photographic opportunities, or images, usually do not contain test objects that can be mapped in a formal 
process like that just described. Scene balance algorithms are designed to perform the task of estimating the reference 
film density as if a gray card had been included in the scene Once an estimate of the film reference density has been 
40 made, the process is duplicated just as described above. The examples show only one color record. Color films contain 
three records to capture the red. green, and blue information from a scene. Thus, the scene balance algonthms must 
perform two tasks. First estimate the overall density of the film image to that the best neutral density is obtained in the 
final print or print through quadrant of the scene. Then the balance between the red. green, and blue exposure must 
be estimated. 

45 

Image Processor Section (box 50, Fig. 2) 

[0045] The first step in the proposed image processing algorithm is deep under correction (box 52). A shift in the print- 
ing density data is performed so that a single column table can be used to shift the red. green, and blue pixel densities. 

so In this instance, the red. green, and blue pixel printing density values are adjusted so that the film minimum densities 
values (D^J are all 0.5. All of the digitized data then is modified by a table look-up process such that image densities 
that occur near or in the film sensitometric toe region are actually reduced to increase the image information gamma. 
The table consists of a single column of numbers. The column represents the substitution values for the red, green and 
blue pixel values. In the final step of the gamma correction process, a shift is applied that restores the density values to 

55 the previous uninitialized D min values. 

[0046] The scene balance shift values are applied to the printing density values (box 54). These values represent the 
shift (add to the red, green, and blue pixel values) necessary to achieve a print that has the correct color balance and 
density. 
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information. The matrix Lspace.mat is used in this process. 

11 -2/3 -11 
t_spacejnv. mat p 4/3 ol 
1 -2/3 1| 



t_space.mat 




,„ [0048] After the tone scale look-up tabte has been appfied to the image, the image data is rotated back to printing 
density space using the matrix t_space_inv.mat. 

Printer Section (box 60) 

Synced, and in aprint density metric. The phctograpruc paper curve is balanced. 
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Unsharp Masking Process 

100501 Thefinal step prior to actually printing the image is the sharpening process(box64^ An unsharp masking algo- 
Ka^ieat^^^ 

D c (x) - D(x) + §(D(x) - J9«)0(x - «d?) 

kernel, below. 
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n, red. green. ««. >*» »W1~ "tf'.^^S^SrflSwi the u»»* |**™» P*W. 

final processed image. The test » "J***^ ^re wave pXn of approximately 40% modulation. The spatial 
using a color negative film. The original target has a ^ ua ^™£^ e ioo%through all of the system visible frequen- 
frequency response values for each frequ«n^ ^^^^^SJxe. digrJlmage for subsequent 

a^ represfntstte maximum MTF ^*>^^ 

rithm, print engine, and print media. Any "^^SSSn V set of parameters considered 
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pversharpening. Values of beta lower than that specified in the report are considered within the scope of this invention 
because these values also deliver prints that meet our printing requirements for making digital prints. If one of the sys- 
tem components is changed, then the beta value will be changed to assure that any final image produced by this digital 
path will achieve the upper limit MTF curve. 



Table 1 





Maximum MTF Values 




Freq 


Red 


Green 


Blue 


0.0 


1.0000 


1.0000 


1.0000 


0.5 


0.9813 


1.0500 


4 A70C 


j 1.0 


0.9680 


1.1180 


1 . 1 423 


1.5 


0.8735 j 


1.0840 


1.094© 


2.0 


0.7118 


0.924 


0.9298 


2.5 


0.5263 


0.7170 


0.7170 


3.0 


0.3523 


0.5380 


0.5238 


3.5 


0.2225 


0.3970 


0.3725 


4.0 


0;1510 


0.2910 


0.2688 


4.5 


0.1150 


0.2140 


0.2023 


5.0 


0.0893 


0.1610 


0.1593 


5.5 


0.0690 


0.1250 


0.1308 


6.0 


0.0530 


0.1000 


0.1095 j 


6.5 


0.0410 


0.0840 


0.0945 


Notes: 

(1) The column labeled "Freq" is spatial frequency in cycles/mm on a 4R reflection print, and the columns 
labeled as colors are the response values for that color at each spatial frequency. 

(2) TheMTF values are given for a 4" x6 m print 250 dots per inch, and1024x I536pixels. 



[0054] Psycho-physical experiments were conducted to compare these digital path prints to a convention optical print- 
ing path. The optically printed images were prepared using a CLAS 35 optical printer running in the full order printing 
mode, thus emulating the SBA operating in our digital path. The scene balance algorithm parameters used in the digital 
40 and optical paths were the same so that similar prints could be prepared. Pairs of prints, digital and optical, were shown 
to a panel of three judges who were asked to choose the best print from the pair. In 75% of the pairs, the digital print 
was selected, citing sharpness as the reason. The remaining 25% were the optical prints selected because of grain 
build-up in the digital prints. 

45 Printer 

[0055] At this point in the process, the printing densities should be fully balanced and corrected. This image informa- 
tion can be printed through a simple printing density to print density look-up table. 

[0056] In the simplest case (printing density to print density), the printing density values are mapped to the appropri- 
50 ate print density values for a positive photographic paper. Trie finished process produces an image that is color and 
density balanced, and in a print density metric. We find the most preferred mapping from the balanced digital color neg- 
ative image onto the characteristic curve of the aim AgX paper results from mapping reference RGB printing densities 
representing an achromatic middle gray onto achromatic RGB paper densities. These RGB paper densities are a func- 
tion of the prim material image dye spectra. 
55 [0057] The final step prior to actually printing the image is the sharpening process which has been described previ- 
ously. 

D G (x) = D{x) + P(D X - MS)D(x - ?)d?) 
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sss^ — 

SSwc thermal Printer, electrophotographic pnnter, etc. 



Printer Calibration 

,006* PHntercal^o^ 

differences between measured and expected den ^ n ^c^ a color calibration may be necessary, 
flares a neutral scale calibration. In m ™^2^^Z*ZZ< code values are printed through an 

EST Twill be appreciated that image sharpening can be 5^^^ p ^S e ^S^S 
KLiCeX that the ^^^^S^X^^ images. ™- can^edoneina 
that are similar to. or better ItaMnaj J^JKSSE- W ^ ,ma9e ^ * 
straight forward manner as described her ^T e "f^ ^ . . 

ttie image dye spectra of the hard copy meda t 8 *«^ e JS«tabte parameters that provide a mechanism to 
fOMM In general, scene contrast modHicaton a ^^°^^ r f^a ^or for specific customers. These 
C« EE*-" for spedf* ^^f^ ^nWot the aTgorrthrr, Or they may be 
aXstable parameters may be fixed for a speahc JJJJ sources. They may be encoded on the capture 
SS by *e software embodiment of tfrej "HJ^j^ 

rned.a optically or magnetically. They may be ™ ^^^^eustomer or processing tab. They maybe 

meS. They may be selected or supplied, d.rectiy ^^rX^ ^^er^ or customer preference. They 
^^Tsottware f^^^Si^ lab preference, or customer 
may also be accessed via the intranet from an avaiiaae repose * 
30 preference. 

Claims 

1 . A method of digital photof inishing comprising the steps of 

^ m a color image captured on alternative capture 

producing a digital color image in printing or other densrt.es of a color .mage cap 

' rr^ingsaa^ 

Sprinting said sharpened digital color image onto hard copy media 

, ^«^teiimane in orirmng densities of an image frame 

photographic element 

• - ^ nrocesses said mapped digital color image with an underex 
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malization algorithm in addition to said scene balance algorithm. 

6. The method of claim 1 wherein said processing step processes said mapped digital color image with an underex- 
posure gamma correction algorithm and a contrast normalization in addition to said scene balance algorithm. 

5 

7. The method of claim 6 wherein said processing step includes the steps of creating a subsampled digital image of 
said digital image, processing said subsampled digital image (1) with an underexposure gamma correction algo- 
rithm; (2) with a scene balance algorithm to produce density shift parameters which are applied to said full digital 
image to produce a scene balanced digital image; and (3) with a contrast normalization algorithm to produce a tone 

w scale look up table (LUT) which is applied to said full digital color image. 

8. The method of claim 1 wherein in said second mapping step said hard copy media is photographic paper and said 
hard copy media characteristic curve is photographic paper characteristic curve, and wherein in said printing step 
said hard copy media is photographic paper. 

15 

9. A method of digital photofinishing comprising the steps of: 

producing a digital color negative image in printing or other densities of a color image captured on a color neg- 
ative photographic element which is optimized for producing a color image suited for conversion to an elec- 
20 tronic form and subsequent reconversion into a viewable form; 

mapping said, printing densities of said digital color negative image to the printing densities that would have 
been obtained for reference color negative photographic element; 

processing said mapped digital color negative image with an underexposure scene balance algorithm; 
mapping said processed digital color negative image through a hard copy media characteristic curve to pro- 
26 duce a digital color positive image; 

sharpening said mapped digital color positive image with a sharpening algorithm optimized to avoid unaccept- 
able artifacts; and 

digitally printing said sharpened digital color image onto hard copy media 

so 10- The method of claim 9 wherein said processing step processes said mapped digital color image with one or both 
of an underexposure gamma correction algorithm and a contrast normalization algorithm in addition to said scene 
balance algorithm. 
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